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W A Method of Kernel Selection for Imagl^Perpolation 
ABSTRACT 

A method of interpolating image data is disclosed. The method accesses a first 
set of discrete sample values of the image data and calculates kernel values for each of the 
discrete sample values using one of a plurality of kernels. The kernel is selected 
depending upon an edge orientation indicator, an edge strength indicator, and an edge 
context indicator for each of the discrete sample values. The calculated kernel values are 
convolved with the discrete sample values to provide a second set of discrete sample 
values. 
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A METHOD OF KERNEL SELECTION FOR 
IMAGE INTERPOLATION 

Field of Invention 

The present invention relates to the field of resolution conversion of multi- 
dimensional digital data, for example digital image data. 

Background Art 

There are several methods available for digital data resolution conversion. 
Popular methods are transform domain methods such as the fractional Fourier transform 
(fractional FFT or Chirp-Z transform), the discrete cosine transform (DCT), and discrete 
wavelet transform (DWT). In addition, there are a number of spatial domain methods 
such as re-sampling and digital filtering with finite-impulse response (FIR) and infinite- 
impulse response (HR) filters and interpolation with continuous, usually cubic, splines. 
When a continuous kernel produces data that passes through original data points, it is 
often called an interpolating kernel. When the interpolated data produced is not 
constrained to pass through the original data points, it is often called an approximating 
kernel. There are a number of constraints that must be met in the design of these 
continuous kernels. 

Commonly used continuous kernels for interpolation are the nearest neighbour 
(NN), linear, quadratic, and cubic kernels. The NN kernel is the simplest method of 
interpolation, which interpolates the image with the pixel value that is spatially nearest to 
the required one. This method works quite well when the scaling ratio is an integer 
multiple of the original data as it introduces no new values (ie., no new colours) and 
preserves sharp edges. However, at other ratios the NN kernel has the disadvantage of 
shifting edge locations which often produces visible distortions in the output image, 
especially in images containing text or fine line details. Linear interpolation on the other 
hand allows for the introduction of new grey levels (or colours) that are effectively used to 
position edges at sub-pixel locations. This has the advantage of reducing the effect of 
shifted edge locations, however sharp edges can appear to be blurred. Quadratic and 
cubic interpolation provide steeper step responses and therefore less edge blurring, 
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however, the steeper response results in an overshoot on either side of the edge. These 
overshoots can make the edges in natural images appear sharper, but on text, fine lines, or 
on other computer generated graphics these overshoots are clearly visible and detract from 
the perceived image quality and text legibility. 
5 From the above, it can be concluded that each kernel as its own strengths and 

weaknesses. Further, there are certain image areas which are best interpolated using 
kernels of different shapes. Simply applying a single continuous convolution kernel at 
every image pixel will not satisfy all of the requirements for a general-purpose resolution 
conversion application. 

10 One known method of generating a kernel with both a steep step response, but no 

overshoot is to adjust the parameters of the cubic kernel according to image information 
so as to remove the overshoot in the step response. The two-parameter Catmull-Rom 
cubic has a kernel of the form: 

(2-h- c)\tf + (-3 + 2b + c)\s\ 2 + (1 ~b) 9 \s\<\ 



(- ~b - c)\s\* + (6 + 5c)\s\ 2 + (-2b - 8c)| j| + (| 6 + 4c), 1 < \s\ < 2 ( 1 ) 

0, Otherwise 



15 Popular choices for the parameters b and c are (b = 0, c = 0.5), which is the 

interpolating cubic that agrees with the first three terms of the Taylor series expansion of 
the original image, and (b = 1, c = 0) which is the approximating cubic B-spline. One 
known method fixes the parameter b at b = 0, whilst c is varied between 0, 0.5, and I 
dependent upon the edge strength measured using a Laplacian of Gaussian (LOG) edge 

20 detector. At a sharp edge c = 0 the resulting cubic is: 

f2W , -3H a +i. H* 1 



(2) 

0, Otherwise 



There is however, a problem with using this kernel to interpolate image data 
when the re-sampled pixel displacement is not significantly different from the original 
pixel displacement, say a re-sampling ratio of 10/1 1 or 1 1/10. In this instance pixels at 
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the edges of text and other fine lines take on a grey value rather than the original black or 
white values. This again results in the blurring of sharp edges and a reduction in the 
observed image quality. 

A further problem with the conventional continuous convolution kernel is 
associated with its application to edges at oblique orientations in the image plane. The 
conventional kernels can be either applied in separable fashion, ie., first to the rows of the 
image and then to the columns, or applied in a 2-dimensional form where they are directly 
convolved with the 2-dimensional image data. However, their orientations in these 
implementations are limited to either: horizontal, vertical, or symmetrical. Upon 
encountering an oblique edge, the pixels on either side of the edge are primarily used in 
the interpolation rather than pixels along the edge. This results in an interpolated edge 
that no longer appears to be clean and smooth, but appears to be jagged, or blurred, or 
both. A solution to the above problem is known whereby interpolation across edges is 
prevented by using extrapolated estimates of pixel values for pixels on the other side of 
the edge in the bilinear interpolation. However, this method requires highly accurate sub- 
pixel edge estimation at the output resolution and iterative post-processing using a 
successive approximation procedure. Both of the above-described methods place high 
demands on memory and processing resources. Another approach to the problem is to 
utilise a set of 2-dimensional "steerable" kernels that can be oriented along the line of an 
edge during image interpolation. In this way the method smooths along the edge line (to 
reduce edge jaggedness), but not across the edge (so preserving edge sharpness). 

A method of selecting interpolation kernels based on edge strength, or user input 
is known. However, there are some defects that prevent this method from working 
optimally. Firstly, the use of edge strength alone as the basis for kernel selection does not 
provide sufficient information for reliable kernel selection (especially at oblique edges). 
Secondly, kernel selection based solely upon user input is impractical and does not 
specify the kernel selection in enough detail, eg., for the example in the sub-image shown 
in Figure 7(a), there is not one single kernel that is ideal for the whole sub-image. In 
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general, different kernels are required at a resolution that is impractical to be specified by 
a user. 

It is an object of the present invention to ameliorate one or more disadvantages 
of the prior art. 

Summary of the Invention 

According to one aspect of the present invention there is provided a method of 
interpolating a first set of discrete sample values to generate a second set of discrete 
sample values using one of a plurality of interpolation kernels, characterised in that said 
interpolation kernel is selected depending on an edge strength indicator, an edge direction 
indicator and an edge context indicator for each discrete sample value of said first set. 

According to another aspect of the present invention there is provided a method 
of interpolating a first set of discrete sample values to generate a second set of discrete 
sample values using an interpolation kernel, characterised in that said interpolation kernel 
are selected depending on an edge strength indicator, an edge direction indicator and an 
edge context indicator for each discrete sample value of said first set. 

According to still another aspect of the present invention there is provided a 
method of interpolating image data, said method comprising the steps of: 
accessing a first set of discrete sample values of said image data; 
calculating kernel values for each of said discrete sample values using one of a 
plurality of kernels depending upon an edge orientation indicator, an edge strength 
indicator, and an edge context indicator for each of said discrete sample values; and 

convolving said kernel values with said discrete sample values to provide a 
second set of discrete sample values. 

According to still another aspect of the present invention there is provided an 
apparatus for interpolating image data, said apparatus comprising: 

means for accessing a first set of discrete sample values of said image data; 
calculator means for calculating kernel values for each of said discrete sample 
values using one of a plurality of kernels depending upon an edge orientation indicator, an 
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edge strength indicator, and an edge context indicator for each of said discrete sample 
values; and 

convolution means for convolving said kernel values with said discrete sample 
values to provide a second set of discrete sample values. 

According to still another aspect of the present invention there is provided a 
computer readable medium for storing a program for an apparatus which processes data, 
said processing comprising a method of inteipolating image data, said program 
comprising: 

code for accessing a first set of discrete sample values of said image data; 

code for calculating kernel values for each of said discrete sample values using 
one of a plurality of kernels depending upon an edge orientation indicator, an edge 
strength indicator, and an edge context indicator for each of said discrete sample values; 
and 

code for convolving said kernel values with said discrete sample values to 
provide a second set of discrete sample values. 

According to still another aspect of the present invention there is provided a 
method of interpolating image data comprising a first mapping of discrete sample values, 
said method comprising the steps of: 

(i) identifying text regions within said first mapping and labelling each 
discrete sample value within each text region; 

(ii) calculating edge information for each of said discrete sample values of 
said image data to identify edge sample values and storing an angle of orientation for each 
of said edge sample values; 

(iii) combining said labels and said angle of orientation for each of said 
discrete sample values to form a second mapping of said discrete sample values; 

(iv) manipulating said angle of orientation for each edge sample value 
within said second mapping to form a third mapping of said discrete sample values; 

(v) manipulating said image data of said third mapping to form a fourth 
mapping of said image data; and 
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(vi) interpolating each sample value of said fourth mapping with a first one 
of a plurality of kernels depending on said labels and said angle of orientation of each of 
said sample values of said fourth mapping to form a fifth mapping of said image data. 

According to still another aspect of the present invention there is provided an 
apparatus for interpolating image data comprising a first mapping of discrete sample 
values, said apparatus comprising: 

means for identifying text regions within said first mapping and labelling each 
discrete sample value within each text region; 

first calculating means for calculating edge information for each of said discrete 
sample values of said image data to identify edge sample values and storing an angle of 
orientation for each of said edge sample values; 

combining means for combining said labels and said angle of orientation for each 
of said discrete sample values to form a second mapping of said discrete sample values; 

manipulating means for manipulating said angle of orientation for each edge 
sample value within said second mapping to form a third mapping of said discrete sample 
values, and manipulating said image data of said third mapping to form a fourth mapping 
of said image data; and 

interpolation means for interpolating each sample value of said fourth mapping 
with a first one of a plurality of kernels depending on said labels and said angle of 
orientation of each of said sample values of said fourth mapping to form a fifth mapping 
of said image data. 

According to still another aspect of the present invention there is provided a 
computer readable medium for storing a program for an apparatus which processes data, 
said processing comprising a method of interpolating image data comprising a first 
mapping of discrete sample values, said program comprising: 

code for identifying text regions within said first mapping and labelling each 
discrete sample value within each text region; 
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code for calculating edge information for each of said discrete sample values of 
said image data to identify edge sample values and storing an angle of orientation for each 
of said edge sample values; 

code for combining said labels and said angle of orientation for each of said 
5 discrete sample values to form a second mapping of said discrete sample values; 

code for manipulating said angle of orientation for each edge sample value 
within said second mapping to form a third mapping of said discrete sample values; 

code for manipulating said image data of said third mapping to form a fourth 
mapping of said image data; and 
10 code for interpolating each sample value of said fourth mapping with a first one 

of a plurality of kernels depending on said labels and said angle of orientation of each of 
said sample values of said fourth mapping to form a fifth mapping of said image data. 

Brief description of drawings 
Fig. 1 is a flowchart showing a method of interpolation in accordance with a first 
15 embodiment of the present invention; 

Fig. 2 is a flowchart showing a method of text detection in accordance with the 
method of interpolation of Fig. 1; 

Fig. 3 is a flowchart showing a method of edge strength and orientation detection 
in accordance with the method of interpolation of Fig. 1; 
20 Fig. 4 is a flowchart showing a method of combining the text map and the edge 

map in accordance with the method of interpolation of Fig. 1; 

Fig. 5 is a flowchart showing a method of cleaning the kernel selection map in 
accordance with the method of interpolation of Fig. 1; 

Fig. 6 is a flowchart showing a method of interpolating an output image in 
25 accordance with the method of interpolation of Fig. 1 ; 

Fig. 7(a) shows an original image at a certain resolution; 

Fig. 7(b) shows the image of Fig. 7(a) at a higher resolution after being 
interpolated using the conventional cubic kernel; 
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10 



Fig. 7(c) shows the image of Fig. 7(a) at a higher resolution after being 
interpolated in accordance with the first embodiment of the present invention; 
Fig. 8(a) shows an original text image; 

Fig. 8(b) shows the text image of fig. 8(a) after being interpolated in accordance 
with the embodiment of the present invention; 

Fig. 9(a) shows a graphic image that has been interpolated using the conventional 
NN kernel; 

Fig. 9(b) shows the graphic image at Fig. 9(a) after being interpolated in 
accordance with the first embodiment of the present embodiment; and 

Fig. 10 is a block diagram of a general purpose computer with which the 
embodiments can be implemented. 

Detailed Description 

When re-sampling a digital image, smooth regions and edge regions need to be 
re-sampled differently. A long symmetrical kernel, such as the conventional Catmull- 
15 Rom cubic with parameter c = 0.5, is ideal for smooth image regions. A short kernel, 
such as the Catmull-Rom cubic with c = 0, is generally good for edge, comer, or highly 
textured regions. However, in order to reduce the jaggy effect on oblique edges, edge 
direction also needs to be taken into account in the interpolation process. Edge direction 
is important so that the interpolation can smooth along an edge, but not across an edge. In 
20 this way, the edge contour is kept smooth, whilst the edge transition is kept sharp. 

The first embodiment of the present invention discloses a method of image 
interpolation that automatically selects the appropriate interpolation kernel for each image 
region. This selection is based not only on edge strength, but also edge direction and local 
edge context information. In addition, high contrast text regions are also detected and 
25 interpolated so as to preserve the shape and contrast of the text. 

The second embodiment of the present invention adjusts the parameters of a 
single interpolation kernel so as to reshape the kernel to the appropriate shape for each 
region in the image. 
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The proposed resolution conversion method first identifies high contrast text 
regions and then measures both edge strength and edge orientation of the image data. In 
the first embodiment, the text and edge information is then used to select the appropriate 
interpolation kernel to use. In the second embodiment, the edge strength and edge 
5 orientation data is used to adjust the parameters of an interpolation kernel. Context 
information, from the text and edge maps, is then used to remove unnecessary kernel 
changes and prevent selection of an inappropriate kernel. This post-processing on the raw 
edge information is required to reduce and remove any interpolation artefacts. 

The disclosed interpolation method according to the preferred embodiment will 
10 be briefly explained with reference to Fig. 1 . The method comprises of a series of steps 
which will be explained in more detail later in this document. The process begins at step 
100 where image data is accessed. The process continues at step 105, where high contrast 
text regions are detected. At step 110, both edge strength and edge orientation of the 
image data are measured. The detected text regions contain cases of isolated pixels, or 
pixel groups, which are labelled as text. To reduce the chances of unnecessary 
interpolation kernel switching, these cases need to be removed. This is done, in the 
preferred embodiment, at the next step 115 using a morphological opening operation 
which is known in the image processing prior art, on the binary text map. The process 
continues at the next step 120, where the detected text regions and edge regions are 
combined into a kernel, or kernel-parameter, selection map for each input pixel. At the 
next step 125, the kernel, or kernel-parameter, selection map is cleaned. This involves re- 
orientating edge regions to an underlying uniformly directed edge region or smooth 
background to produce a cleaned kernel selection map at step 130. The cleaned kernel 
selection map is at the input pixel resolution. The process continues at the next step 135, 
where the cleaned kernel selection map is interpolated using the NN interpolation kernel. 
The result of the NN interpolation is to produce the kernel, or kernel-parameter, selection 
map for each output pixel, at step 140. At the next step 145, the appropriate interpolation 
kernel, based on the output-resolution kernel selection map, is applied to the image data. 
The interpolation kernel applied to the image data, at step 145, can be a Universal Cubic 
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Kernel 150 in accordance with the preferred embodiment, which will be disclosed later in 
this document. The process concludes at step 155, where the resolution converted output 
image is preferably displayed or further processed by a graphics processor or the like. 

The above steps do not have to operate on the complete image at any one time. 
5 However, for simplicity the preferred embodiment will be described in terms of 
processing the complete image of input pixels. It is desirable, although not mandatory, 
that the algorithm according to the preferred embodiment operate in a memory-localised 
manner so that only a limited number of lines (preferably 5 lines in the raster scan 
direction) of the input image are required at any one time. Alternatively, the algorithm 
10 can be applied to arbitrary image sub-regions, or blocks. 

The following description of the preferred embodiment is described in terms of 
colour images represented in a Red, Green, Blue (RGB) colour space. With suitable 
modifications the technique can easily be applied to grey level images (only one colour 
plane) or any arbitrary colour space representation (such as YUV, or YCbCr). 
15 Alternatively, if images are presented in another colour space they can first be 
transformed to an RGB colour space before being processed. 

The above steps of the present invention will now be explained in more detail 
with reference to Figures 1 to 6. 
Text detection and text map cleaning step : 
20 The text detection and text map cleaning is explained with reference to Fig. 2. 

The local contrast between neighbouring pixels is used as the basis of text region 
detection. Text regions are usually regions where the local contrast is high, the number of 
colours is limited, and the texture is simple. These criteria allow the detection of 
multilingual text information rendered in a high contrast fashion. 
25 The process begins at step 200, where the text map is initialised to smooth. At 

the next step 205, the following steps 215 to 230 are carried out for each colour plane and 
for each pixel in the image. Each pixel and colour plane of the input image is scanned 
with a 3 by 3 neighbourhood operator. At step 2 15, for each centre pixel, P0, the value C 
is compared with a threshold, Ttxt, where C is given as follows: 
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C = max((Po-/»|), /el,..,8 (3) 

and where / is the index of the 8 nearest neighbour pixels of the centre pixel PO. In the 
preferred embodiment a value of Ttxt = 220 is used. At the next step 220, the value of C 
is compared with the threshold, Ttxt. If the value of C is over the threshold, Ttxt, the pixel 
5 PO is labelled as text region at step 225. 

The detected text regions contain cases of isolated pixels, or pixel groups, which 
are labelled as text. To reduce the chances of unnecessary interpolation kernel switching, 
these cases need to be removed. This is done, in the preferred embodiment, at the next 
step 230 using a morphological opening operation which is known in the image 
10 processing prior art, on the binary text map. A structuring element defined by matrix 5 is 
used to clean the text detection map as follows- 

•i 'i 

The morphological opening operation, which is defined as an erosion followed 
by a dilation with S, removes the following patterns (including their rotated versions): 

15 [o o]{l o}[l J] 

The text detection and text map cleaning process concludes after steps 215 to 
230 have been carried out for each pixel in the image. 
Edge strength a nd direction detection step : 

The edge strength and direction detection step will be explained with reference to 
20 Figure 3. The process begins at step 300, where the edge map is initialised to smooth. At 
the next step 305, the following steps 315 to 335 are carried out for each colour plane and 
for each pixel in the image. At step 315, horizontal and vertical edge responses, which we 
shall refer to as Gh and Gv respectively, are calculated for each input image pixel. In the 
preferred embodiment this is done utilising a 5-tap optimal edge detector which is known 
25 in the art. The coefficients used for forming Gh and Gv are shown in Table 1 



Low-pass 


0.036420 


0.248972 


0.429217 


0.248972 


0.036420 


High-pass 


-0.108415 


-0.280353 


0 


0.280353 


0.108415 
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Table 1. Edge Detection coefficients used in the preferred embodiment. Shown are the 
low-pass (interpolating) and high-pass (first derivative) kernels. 

At the next step 320, the gradient magnitude, Gm 9 is obtained from the strengths 
of these two components using: 



(5) 



The maximum gradient value in the R, G, and B colour components is used to 
determine the overall edge gradient strength. The process continues at the next step 320 
where the gradient magnitude, Gm, is compared with a threshold Gth. If it is less than the 
threshold, the pixel is classified as a non-edge pixel. Otherwise the pixel is classified to 
be an edge pixel and the edge direction G6 recorded in the EdgeMap, at step 330. 
Therefore, the colour plane with the maximum gradient strength is used to estimate the 
edge direction for each input pixel. The edge gradient direction, G6, is estimated using: 
G fl= tan-|- (4) 

The process continues at step 335, where the edge pixel direction is quantised 
into one of the four cases: horizontal (0), vertical (ti/2), diagonal (te/4), and anti-diagonal 
(3n/4). 

The edge strength and direction detection process concludes after steps 315 to 
335 have been carried out for each pixel in the image. 

It is noted that by increasing the number of quantisation bins and interpolating 
with the correspondingly oriented steerable kernels, better interpolation output can be 
produced. However, this also increases the complexity of the implementation and so 
quantisation into 4 directions is used in the preferred embodiment. 
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Combination of the text and edge information into the kernel selection map : 

The combination of the text and edge information into the kernel selection map 
will now be explained with reference to Figure 4. It is assumed that the input image is 
smooth with the exception of the pixels where edge or text regions have been detected. 
The kernel selection map is therefore initialised, at step 400, to select a generic smoothing 
kernel. In the preferred embodiment a cubic interpolation kernel with parameter c = 0.5 is 
used for interpolating pixels in these smooth regions. The process continues at step 405, 
where steps 410 to 425 are carried out for each pixel in the input image where the text 
region and edge region (edge direction) information is then superimposed onto the kernel 
selection map. Where both text region and edge region are present, the text region 
information takes precedence. The precedence of the text region over edge region is an 
important one since there are lots of edge activities in text regions and counting them as 
directional edges can cause excessive kernel switching and therefore visual artefacts. The 
process continues at step 410 where a check is carried out to see if the current pixel in the 
EdgeMap is classified as smooth. If the current pixel in the EdgeMap is not smooth, the 
EdgeMap information is recorded in the KernelMap, at step 415. At the next step 420, a 
check is carried out to see if the current pixel in the TextMap is classified as smooth. If 
the current pixel in the TextMap is not smooth, the TextMap information is recorded in 
the KernelMap, at step 425. The combination of the text and edge information into the 
kernel selection map process concludes after steps 410 to 425 have been carried out for 
each pixel in the input image. 
Cleaning of the kernel selection map : 

The cleaning of the kernel selection map process is explained with reference to 
Figure 5. There are cases of isolated edge directions occurring in an otherwise uniformly 
directed local region. These sparsely distributed edge regions are best re-oriented to the 
underlying uniformly directed edge region or smooth background. This again is to avoid 
excessive kernel switching which may result in visual artefacts in the interpolated image. 

The process begins at step 500 where the accumulators are initialised. At the 
next step 505, the steps 510 to 540 are carried out for each 5 by 5 block in the KernelMap. 
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At step 510, in a 5x5 neighbourhood, the number of edge pixels of each edge orientation 
(including text and background) are accumulated. The process continues at step 515 
where the major edge orientations are identified. At the next step 520, the minor edge 
orientations are identified. The major and minor edge orientations are identified and 
minor edge pixels are reassigned to the major orientation in the following steps, with the 
exception of identified text region pixels. At the next step 525, the calculated major edge 
orientation is compared with Tmajor and the calculated minor edge orientation is 
compared with Tminor. At step 530, an orientation is set to be the major orientation if 
there are more than Tmajor pixels in the 5 by 5 region and an orientation is set to be a 
minor orientation if there are less than Tminor pixels in the 5 by 5 region. In the preferred 
embodiment , the major threshold, Tmajor, is 15 and the minor threshold, Tminor, is 5. 
The total number of pixels in the 5 by 5 region is 25. If the accumulated edge pixels are 
above the major threshold, a major edge direction is found. Otherwise, the pixel region 
remains unchanged. The major or minor orientations can also be background or text 
regions. At the next step 535, the 5 by 5 pixel block shifts one column along the image 
buffer and the process repeats for the next adjacent 5 by 5 pixel block. These blocks do 
not overlap each other in any single pass of the image. The process iterates a fixed 
number of times, and a check is carried out at step 540 to see if 5 iterations have been 
completed at which point the process will conclude. In the preferred embodiment, 5 
iterations are sufficient to clean the map to a reasonable degree, however 5 iterations are 
not mandatory. 

Apply int erpolation to cleaned kernel selection map : 

The step of applying interpolation to the cleaned kernel selection map will now 
be explained with reference to Figure 6. The process begins at step 600, where the kernel 
selection map (KernelMap) is interpolated to be the same size as the output image. The 
nearest neighbour (NN) interpolation method is used to obtain the kernel selection map at 
the required output resolution. NN interpolation is used to reduce the computation cost 
associated with more complex interpolation methods (such as linear and cubic) without 
significantly reducing the output image quality. Alternatively, the NN interpolation is not 
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actually carried out, but the kernel is selected in the O/P image dependent on the nearest 
pixel in the KernelMap. 

After the kernel selection map (KernelMap) has been interpolated to be the same 
size as the output image, each entry is read so that the correct interpolation kernel can be 
used. At the next step 610, a check is carried out to see if the KernelMap information is 
classified as text. If KernelMap = Text then the text pixel is interpolated with a modified 
cubic kernel, at step 615. The modified cubic kernel of the preferred embodiment, h(s), is 
given by: 



1, -d<s<d 

0, (\-d) >s >(!-</) 



s-d 



l-2d 



-3 



s-d 



\-2d 



+ 1. 



(5) 



where t/At is a normalised coordinate that has integer values at the sample points. 

In the preferred embodiment parameter, d, is set to 0.2. Note this kernel has a 
reduced size of 2-by-2. 

The process continues at step 620, if the KernelMap is not classified as text, 
where a check is carried out to see if the KernelMap information is classified as an edge. 
If KernelMap = Edge, then the edge pixels are interpolated with one of the four steerable 
cubic kernels at step 625. The steerable kernels of the preferred embodiment, where h(s x . 
Sy), are given by: 

h(s x ,s y ) Q=0 = -L {h(s x ) c=05 ■ h(s y ) c=0 \ 
h (s x ,s y )Q =n/2 = -j= {h(s x ) c=0 ■ h(s y ) c=0 } 



(6) 
(7) 



(8) 
(9) 
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where s x = x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. The quantised edge 
orientations define the required orientation of the steerable cubic kernel, ie., either 0, rc/4, 
n/2, or 3n/4. 

5 The process continues at step 630 where, if the KemelMap is not classified as an 

edge, a check is carried out to see if the KemelMap information is smooth. If KemelMap 
= Smooth, then the pixels are interpolated with the conventional Catmull-Rom cubic 
kernel (b = 0, c = 0.5). 

Figs. 7 to 9 illustrate the interpolation efficacy of the present invention on a 
10 number of typical images. Fig. 7(a) shows an original image at a certain resolution before 
interpolation has taken place. Fig. 7(b) shows the image of Fig. 7(a) at a higher resolution 
after being interpolated using the conventional cubic kernel. In contrast, Fig. 7(c) shows 
the image of Fig. 7(a) at a higher resolution after being interpolated in accordance with 
the preferred embodiment of the present invention. It can be seen that Fig. 7(c) shows an 
15 image with sharper edges and less blurring than Fig. 7(b). 

Fig. 8(b) shows the text image of Fig. 8(a) that has been enlarged to 2.7 times in 
both directions using the interpolation method in accordance with the preferred 
embodiment of the present invention. 

Fig. 9(a) shows a graphic image that has been interpolated using a conventional 
20 NN kernel. Fig. 9(b) shows the same graphic image that has been interpolated using the 
interpolation method in accordance with the preferred embodiment of the present 
invention. It can be seen from the image in Fig. 9(b) that the oblique lines are smoothed 
along their directions compared to the image of Fig. 9(a). 

In the second embodiment of the present invention the KemelMap does not 
25 contain an encoding for the different kernels that can be used in the interpolation, but 
rather parameter values to be applied to one "universal" kernel. The definition of the 
universal cubic interpolation kernel, being a combination of the conventional kernel of 
equation (1), the modified kernel of equation (5), and fully steerable cubic kernels of 
equations (6), (7), (8) and (9), is as follows: 
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(10) 

=^W( 2tf/ff - 1 ^ + (20/n-2)s y ) c _ aJ h{(i29/ J r-2)s x + (l-20//r), y )H<0))> J 

01) 

Where the across edge weighting factor, w(6), is a smooth function constrained 
to pass through 1 when 9 = 0, Jt/2, and tc and through V2 when 0 = tt/4 and 37i/4. The 
function used in the preferred embodiment is as follows: 



10 w($) = l + 



71-1 



cos(46>) 



(12) 



And the universal interpolation kernel, h(s), is given by 

1, 0<|5j^rf 

s-d> 



h(s) = 



(2 —b-c) 

2 l-2d 

0, l-d<\s\<l + d 



i--b-c) 
o 



0, Otherwise 



+ (-3 + 26 + c) 



s-d 



\-2d 



I 



+ Q--b), d<\s\<l-d 



s-3d 


3 


+ (b + 5c) 


I -2d 



s-3d 



l-2d 



+ (-26 -8c) 



l-2rf 



+ (-6 + 4c), 1 + d < \s\ < 2 -d 



(13) 

where d is the parameter controlling the width of a "dead zone" of the cubic interpolation 
15 kernel. 

Based on the kernel-parameter map, the input image regions are interpolated with 
the universal cubic kernel with parameters set as follows: 

Text regions are interpolated with the edge orientation angle parameter, 9=0, 
the "dead zone" parameter, d = 0.2, and cubic parameters b = 0 and c = 0. This gives a 
20 reduced kernel size of 2-by-2, ie., the remaining kernel coefficients are all zero. 



CFP1111AU RC07 483325 



[O:\ClSRA\RC\RC071AUspeci:SaF 



-18- 



Edge regions are interpolated with 0 set to either 0, n/4, nil, or 3rc/4 (dependent 
on the edge angle, GO), d = 0, b = 0, and c = 0.5. This is a 4 by 4 kernel, though either 6 
or 8 of these coefficients will be zero, depending on the orientation angle (8). 

Smooth regions are interpolated with 9 = 0, d = 0, b = 0, and c = 0.5. This is a 4 
by 4 non-zero kernel. 

Preferred Embodiment of Apparatus(s) 

The preferred method is preferably practiced using a conventional general- 
purpose computer system, such as the system 1000 shown in Fig. 10, wherein the process 
of Figs. 1 to 6 can be implemented as software executing on the computer. In particular, 
the steps of the method are effected by instructions in the software that are carried out by 
the computer. The software can be divided into two separate parts; one part for carrying 
out the method of the preferred embodiment; and another part to manage the user 
interface between the latter and the user. The software can be stored in a computer 
readable medium, including the storage devices described below, for example. The 
software is loaded into the computer from the computer readable medium, and then 
executed by the computer. A computer readable medium having such software or 
computer program recorded on it is a computer program product. The use of the 
computer program product in the computer preferably effects an advantageous apparatus 
for orientating a character stroke or n-dimensional finite space curves in accordance with 
the embodiments of the invention. 

The computer system 1000 has a computer module 1002, avideo display 1016, 
and input devices 1018, 1020. In addition, the computer system 1000 can have any of a 
number of other output devices including line printers, laser printers, plotters, and other 
reproduction devices connected to the computer module 1002. The computer system 
1000 can be connected to one or more other computers via a communication interface 
1008c using an appropriate communication channel 1030 such as a modem 
communications path, a computer network, or the like. The computer network can 
include a local area network (LAN), a wide area network (WAN), an Intranet, and/or the 
Internet. 
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The computer module 1002 has a central processing unit(s) (simply referred to as 
a processor hereinafter) 1004, a memory 1006 which can include random access memory 
(RAM) and read-only memory (ROM), input/output (IO) interfaces 1008, a video 
interface 1010, and one or more storage devices generally represented by a block 1012 in 
Fig. 10. The storage device(s) 1012 can include of one or more of the following: a floppy 
disc, a hard disc drive, a magneto-optical disc drive, CD-ROM, magnetic tape or any 
other of a number of non-volatile storage devices well known to those skilled in the art. 
Each of the components 1004 to 1012 is typically connected to one or more of the other 
devices via a bus 1014 that in turn has data, address, and control buses. 

The video interface 1010 is connected to the video display 1016 and provides 
video signals from the computer 1002 for display on the video display 1016. User input 
to operate the computer 1002 can be provided by one or more input devices 1008. For 
example, an operator can use the keyboard 1018 and/or a pointing device such as the 
mouse 1020 to provide input to the computer 1002. 

The computer system 1000 is simply provided for illustrative purposes and other 
configurations can be employed without departing from the scope and spirit of the 
invention. Exemplary computers on which the embodiment can be practiced include the 
IBM-PC/ATs or compatibles, one of the Macintosh (TM) family of PCs, Sun Sparcstation 
(TM), arrangements evolved therefrom. The foregoing are merely exemplary of the types 
of computers with which the embodiments of the invention can be practiced. Typically, 
the processes of the embodiments, described hereinafter, are resident as software or a 
program recorded on a hard disk drive (generally depicted as block 1012 in Fig. 10) as the 
computer readable medium, and read and controlled using the processor 1004. 
Intermediate storage of the program and pixel data and any data fetched from the network 
can be accomplished using the semiconductor memory 1006, possibly in concert with the 
hard disk drive 1012. 

In some instances, the program can be supplied to the user encoded on a CD- 
ROM or a floppy disk (both generally depicted by block 1012), or alternatively could be 
read by the user from the network via a modem device connected to the computer, for 
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example. Still further, the software can also be loaded into the computer system 1000 
from other computer readable medium including magnetic tape, a ROM or integrated 
circuit, a magneto-optical disk, a radio or infra-red transmission channel between the 
computer and another device, a computer readable card such as a PCMCIA card, and the 
Internet and Intranets including email transmissions and information recorded on websites 
and the like. The foregoing are merely exemplary of relevant computer readable 
mediums. Other computer readable mediums can be practiced without departing from the 
scope and spirit of the invention. 

The preferred method of reconstructing a continuous signal can alternatively be 
implemented in dedicated hardware such as one or more integrated circuits performing the 
functions or sub functions of the steps of the method. Such dedicated hardware can 
include graphic processors, digital signal processors, or one or more microprocessors and 
associated memories. 

The foregoing only describes two embodiments of the present invention, 
however, modifications and/or changes can be made thereto by a person skilled in the art 
without departing from the scope and spirit of the invention. 

In the context of this specification, the word "comprising" means "including 
principally but not necessarily solely" or "having" or "including" and not "consisting only 
of. Variations of the word comprising, such as "comprise" and "comprises" have 
corresponding meanings. 
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€fsmmS: 

The clafrrra defining tffo Invention are a$ follows: 

1. A method of interpolating a first set of discrete sample values to generate a 
second set of discrete sample values using one of a plurality of interpolation kernels, 
characterised in that said interpolation kernel is selected depending on an edge strength 
indicator, an edge direction indicator and an edge context indicator for each discrete 
sample value of said first set. 



2. The method according to claim 1, wherein said interpolation kernel is a universal 
interpolation kernel, h(s). 

3. The method according to claim 2, wherein said universal interpolation kernel, 
h(s), is of the form: 



1, 0<|s|<</ 



s-d 



(2 — b-c) 

2 '\-2d 

0, l-d<\s\<l + d 
1 



+ (-3 + 2b + c) 



s-d 



I -2d 



+ (1-jZ>), d<\s\<\-d 



{--b-c) 
o 

0, Otherwise 



s-3d 


i 


+ (b + 5c) 


l-2d 



s-3d 



\-2d 



+ (-26 -8c) 



s-3d 



\-2d 



+ (-6 + 4c), \+d<\s\<2 



and wherein s=t/At and 0 < d < 0.5. 

4. The method according to claim 1 , wherein said plurality of kernels are given by: 
h (s x ,s y ) Q=0 = -j= [h(s x ) c=05 - h(s y ) c=0 } 

Ks x ,s y )Q =n / 2 = -j^ [Hs x )c=0 • Ksy) c =0J 



CFP1111AU RC07 483325 



(0:\asRA\RC\RC07]AUsped:SaF 



22- 



( S X +Sy\ ( S x ~Sy \ 

l 2 ) c=05 * l VJ ) c=0 \ 
{ ^ K=0 { 2 K=0.5 



and wherein s x = x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. 

5. The method according to claim 1, wherein said first set of discrete sample values 
are at a different resolution to said second set of discrete sample values. 

6. A method of interpolating a first set of discrete sample values to generate a 
second set of discrete sample values using an interpolation kernel, characterised in that 
said interpolation kernel are selected depending on an edge strength indicator, an edge 
direction indicator and an edge context indicator for each discrete sample value of said 
first set. 

7. The method according to claim 6, wherein said interpolation kernel is a universal 
interpolation kernel, h(s). 



8. The method according to claim 7, wherein said universal interpolation kernel, 

h(s), is of the form: 
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h(s) = 



1, 0<|s|<rf 



s-d 



(2--6-c) 

2 J \-2d 

0, l-d<\s\<l + d 
o 

0, Otherwise 



+ (-3 + 2b + c) 



s-d 



\-2d 



+ (l--b), d<\s\<\-d 



s-3d 


1 


+ (b + 5c) 


\-2d 



s-3d 



+ (-26 -8c) 



s-3d 



l-2d 



+ (-6 + 4c), l + rf<|s|< 



and wherein s = t/At and 0 < d < OJ. 

9. The method according to claim 6, wherein said first set of discrete sample values 
are at a different resolution to said second set of discrete sample values. 

10. A method of interpolating image data, said method comprising the steps of: 
accessing a first set of discrete sample values of said image data; 
calculating kernel values for each of said discrete sample values using one of a 

plurality of kernels depending upon an edge orientation indicator, an edge strength 
indicator, and an edge context indicator for each of said discrete sample values; and 

convolving said kernel values with said discrete sample values to provide a 
second set of discrete sample values. 

11. The method according to claim 10, wherein said kernel is a universal 
interpolation kernel, h(s). 

12. The method according to claim 1 1, wherein said universal interpolation kernel, 
h(s) % is of the form: 
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h(s) = 



1, 0<\s\<d 



2 '\-2d 
0, l-<f <|s|<l+rf 



+ (-3 + 26 + c) 



l-2d 



+ 0-j6), J<|*|<l-d 



1 



(--b-c) 
6 \-2d 

0, Otherwise 



s-3d 



+ (b + 5c) 



s-3d 



\-2d 



+ (-26 -8c) 



s-3d 



l-2d 



+ (-b + 4c), \ + d<\s\<2- 



and wherein s = t/At and 0 < d < 0.5. 



13. The method according to claim 1 1 , wherein said plurality of kernels are given by: 
Ks x ,Sy) e=0 = -jj [h(s x ) c=os ■ h(s y ) c=0 ] } 

Ks x ,Sy)Q =n/2 = {h(s x ) c =o ■ Ksy) c=os 



Ks x ,Sy)B =1z / 4 = 



T2 



s x ~ s y 



c=0.5 



42 



■h 



c=0 



s x ~ s y 



c=0.5\ 



and wherein s x - x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. 

14. The method according to claim 10, wherein said first set of discrete sample 
values are at a different resolution to said second set of discrete sample values. 



15. An apparatus for interpolating image data, said apparatus comprising: 

means for accessing a first set of discrete sample values of said image data; 
calculator means for calculating kernel values for each of said discrete sample 

values using one of a plurality of kernels depending upon an edge orientation indicator, an 
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edge strength indicator, and an edge context indicator for each of said discrete sample 
values; and 

convolution means for convolving said kernel values with said discrete sample 
values to provide a second set of discrete sample values. 

16. The apparatus according to claim 15, wherein said kernel is a universal 
interpolation kernel, h(s). 

1 7. The apparatus according to claim 16, wherein said universal interpolation kernel, 
h(s), is of the form: 



1, 0<|s|<</ 



h(s) = 



s-d 



(2--b-c) 

2 J \-2d 

0, \-d<\s\<\ + d 
o 

0, Otherwise 



+ {-3 + 2b + c) 



s-d 



l-2d 



+ d<\s\<l-d 



s-3d 


3 


+ (b + 5c) 


\-2d 



s-3d 



l-2d 



+ (-26 -8c) 



s-3d 



l-2d 



+ (-b + 4c), l + rf<|.y|< 



and wherein s = t/At and OS d <0.5. 



18. The apparatus according to claim 15, wherein said plurality of kernels are given 
by: 

Ks x ,s y )Q =0 = -j= [h(s x ) c=05 • h(s y ) c=0 \ 
h (s x ,Sy)e= n /2 = {Ks x )c=0 • Ksy) c=0 .s 
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and wherein s x = x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. 

5 19. The method according to claim 15, wherein said first set of discrete sample 
values are at a different resolution to said second set of discrete sample values. 

20. A computer readable medium for storing a program for an apparatus which 
processes data, said processing comprising a method of interpolating image data, said 
10 program comprising: 

code for accessing a first set of discrete sample values of said image data; 

code for calculating kernel values for each of said discrete sample values using 
one of a plurality of kernels depending upon an edge orientation indicator, an edge 
strength indicator, and an edge context indicator for each of said discrete sample values; 
15 and 

code for convolving said kernel values with said discrete sample values to 
provide a second set of discrete sample values. 



21. The computer readable medium according to claim 20, wherein said kernel i 
20 universal interpolation kernel, h(s). 



is a 



22 



The computer readable medium according to claim 21, wherein said universal 
interpolation kernel, h(s), is of the form: 
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h(s) = 



1, Oz\s\<d 



(2 — b-c) 

2 } \-2d 

0, \-d<\s\<l + d 



s-d 



+ (-3 + 2b + c) 



s-d 



l-2d 



+ (\-U), d<\s\<:i-d 



(--b-c) 

O 

0, Otherwise 



s-3d 


3 


+ (6 + 5c) 


\-2d 



s-3d 



\-2d 



+ (~2b -8c) 



s-3d 



\-2d 



+ (-6 + 4c), l+rf<| J |< 



and wherein s = / /At and 0 < d < 0.5. 



23. The computer readable medium according to claim 21, wherein said plurality of 
kernels are given by: 

Ks x ,Sy)e=0 = -jj {h(s X )c=0.5 ' h ( s y)c=o) 
h(s x ,s y )Q =n/2 = -j= {h(^) c=0 • h(s y ) c=05 



S X ~Sy 

~ir. 



and wherein s x = x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. 



24. The computer readable medium according to claim 20, wherein said first set of 
discrete sample values are at a different resolution to said second set of discrete sample 



values. 



25. A method of interpolating image data comprising a first mapping of discrete 
sample values, said method comprising the steps of: 



CFP1111AU RC07 4B3325 



(O:\CISRA\RC\RC07JAUsp8ci:SaF 



-28 



(i) identifying text regions within said first mapping and labelling each 
discrete sample value within each text region; 

(ii) calculating edge information for each of said discrete sample values of 
said image data to identify edge sample values and storing an angle of orientation for each 

5 of said edge sample values; 

(iii) combining said labels and said angle of orientation for each of said 
discrete sample values to form a second mapping of said discrete sample values; 

(iv) manipulating said angle of orientation for each edge sample value 
within said second mapping to form a third mapping of said discrete sample values; 

10 (V) manipulating said image data of said third mapping to form a fourth 

mapping of said image data; and 

(vi) interpolating each sample value of said fourth mapping with a first one 
of a plurality of kernels depending on said labels and said angle of orientation of each of 
said sample values of said fourth mapping to form a fifth mapping of said image data. 



15 



20 



26 



The method according to claim 25, wherein step (v) comprises the following sub- 
steps: 

0 

(v)(a) associating each discrete sample value of said fourth mapping with a 
corresponding discrete sample value of said third mapping; 

(v)(b) scaling said third mapping of said image data based on said association. 

27. The method according to claim 25, wherein step (v) comprises the step of 
interpolating said image data of said third mapping using a second kernel. 



25 28 



The method according to claim 26, wherein said second kernel is an NN 
interpolation kernel. 
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29. The method according to any one of claim 25, wherein said labels and said angle 
of orientation of each of said sample values of said fourth mapping are used to select 
kernel parameter values of said first kernel. 

30. The method according to claim 25, wherein said first kernel is a universal 
interpolation kernel, h(s). 

31. The method according to claim 30, wherein said universal interpolation kernel, 
h(s) 9 is of the form: 



h(s) = 



1, 0<\s\<d 



s-d 



(2--b-c) 

2 \-2d 

0, l-d<\s\<l + d 

{-\b-c) 
o 

0, Otherwise 



+ (-3 + 2b + c) 



s-d 



\-2d 



+ d<\s\<l-d 



s-3d 


3 


s-3d 


2 


s-3d 


+ (6 + 5c) 


+ (-26-8c) 


l-2d 


l-2d 


\-2d 



+ (-& + 4c), l + d <\s\ < 



wherein s = t/At and 0 < d <0.5. 



32. The method according to claim 25, wherein said plurality of kernels are given by: 



*(*x.Jy)e=0 = \ h ( s x)c=0 5 ' h(sy) c=0 \ 
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wherein s x = x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. 

33. The method according to claim 25, wherein said steps (i) to (vi) are carried out 
on one of a plurality of portions of said first mapping of discrete sample values of said 
image data. 



34. The method according to claim 25, wherein the labels take precedence over said 
angle of orientation when forming said second mapping of said discrete sample values 

35. The method according to claim 25, wherein said fourth mapping is at a different 
resolution to said first mapping. 

36. The method according to claim 25, wherein said image data is colour image data. 

37. The method according to claim 36, wherein steps (i) and (ii) are carried out for 
each colour plane of said colour image data. 

38. The method according to claim 36, wherein steps (i) and (ii) are carried out for a 
luminance component of said colour image data. 

39. The method according to claim 25, wherein step (i) includes the following sub- 
steps: 

(i)(a) calculating a text indicator value, C; and 

(i)(b) comparing said text indicator value with a threshold value, wherein said labelling 
of each discrete sample value within each text region is based on said comparison. 

40. The method according to claim 39, wherein said text indicator, C, is of the form: 
C = max(JP 0 -/>|), /el,..,8 
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and wherein / is the index of the 8 nearest neighbour discrete sample values to a centre 
discrete sample value, PO. 



41. The method according to claim 39, wherein step (i) includes the following sub- 
step: 

(0(c) performing a cleaning operation on said text labels. 

42. The method according to claim 41, wherein said cleaning operation is a 
morphological opening operation. 

43. The method according to claim 25, wherein step (ii) includes the following sub- 
steps: 

(ii)(a) calculating edge response values for each of said discrete sample values; 
(ii)(b) calculating a gradient magnitude value based on said edge response 
values; and 

(ii)(c) comparing said gradient magnitude value with a threshold value; 
(ii)(d) classifying a current pixel on the basis of said comparison; 
(ii)(e) calculating said angle of orientation for a current pixel based on said 
comparison; and 

(ii)(f) storing said angle of orientation. 

44. The method according to claim 43, wherein said gradient magnitude value, Gm , 
is of the form: 

G.=V G v+G A \and 
wherein Gv and Gh are the vertical and horizontal edge responses, respectively. 

45. The method according to claim 43, wherein said edge gradient value, G6 , is of 
the form: 
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wherein Gv and Gh are the vertical and horizontal edge responses, respectively. 

46. The method according to claim 25, wherein step (iv) includes the following sub- 
steps: 

(iv)(a) accumulating a number of discrete data values of each angle of 
orientation for one of a plurality of portions of said discrete data values; 

(iv)(b) calculating a highest value and lowest value of discrete sample values 
for each angle of orientation; 

(iv)(c) comparing said highest and lowest values with highest and lowest 
threshold values, respectively; 

(iv)(d) reassigning an angle of orientation of said discrete data values of said 
portion on the basis of said comparison; and 

(iv)(e) repeating steps (iv)(a) to (iv)(e) for each of said portions of said discrete 
data values. 



47. The method according to claim 46, wherein said plurality of portions of said 
discrete data values is five portions. 

48. The method according to claim 25, wherein a modified cubic interpolation kernel 
is applied to a discrete data value which is labelled as text. 



49. The method according to claim 48, wherein said modified cubic interpolation 
kernel, h(s), is of the form: 
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1, -d<s<d 

0, (!-</)> s>(l~d) 




+ 1, 



wherein s= t/Ai is a normalised coordinate that has integer values at a sample point and 0 



<d<0.5. 



50. The method according to claim 25, wherein a steerable cubic interpolation kernel 
is applied to a discrete data value which is classified as an edge. 

51. The method according to claim 50, wherein said steerable cubic interpolation 
kernels, h(sx,sy) y are of the form: 



wherein s x = x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. 

52. The method according to claim 50, wherein a conventional cubic interpolation 
kernel is applied to a discrete data value which is classified as smooth. 

53. The method according to claim 52, wherein said conventional cubic interpolation 
kernel is of the form: 




Ks x > s y)Q=n/4 
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(2--b-c)\sf +(-3 + 2& + c)|*| 2 +(\--b), \s\<l 

2 3 

Ks) = \(r^b- c)\sf + (6 + 5<:)|s| 2 + (-26 - 8c)|s| + (1 6 + 4c), 1 < | j| < 2 
0, Otherwise 



and wherein 6 = 0 and c = 0.5. 

54. An apparatus for interpolating image data comprising a first mapping of discrete 
sample values, said apparatus comprising: 

means for identifying text regions within said first mapping and labelling each 
discrete sample value within each text region; 

first calculating means for calculating edge information for each of said discrete 
sample values of said image data to identify edge sample values and storing an angle of 
orientation for each of said edge sample values; 

combining means for combining said labels and said angle of orientation for each 
of said discrete sample values to form a second mapping of said discrete sample values; 

manipulating means for manipulating said angle of orientation for each edge 
sample value within said second mapping to form a third mapping of said discrete sample 
values, and manipulating said image data of said third mapping to form a fourth mapping 
of said image data; and 

interpolation means for interpolating each sample value of said fourth mapping 
with a first one of a plurality of kernels depending on said labels and said angle of 
orientation of each of said sample values of said fourth mapping to form a fifth mapping 
of said image data. 



55. The apparatus according to claim 54, wherein said apparatus further comprises: 
associating means for associating each discrete sample value of said fourth 

mapping with a corresponding discrete sample value of said third mapping; 

scaling means for scaling said third mapping of said image data based on said 

association. 
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56. The apparatus according to claim 54, said apparatus further comprising 
interpolation means for interpolating said image data of said third mapping using a second 



kernel. 



57. The apparatus according to claim 56, wherein said second kernel is an NN 
interpolation kernel. 

58. The apparatus according to any one of claim 54, wherein said labels and said 
angle of orientation of each of said sample values of said fourth mapping are used to 
select kernel parameter values of said first kernel. 

59. The apparatus according to claim 54, wherein said first kernel is a universal 
interpolation kernel, h(s). 

60. The apparatus according to claim 59, wherein said universal interpolation kernel, 
h(s), is of the form: 



h(s) = 



1, 0<|*|iSrf 



(2--b-c) 

2 '\-2d 

0, l-d<\s\<l + d 



s-d 



+ (-3 + 2b + c) 



s-d 



l~2d 



+ 0--U), d<\s\<\-d 



1 



(~-b-c) 
6 '\-2d 

0, Otherwise 



s-3d 



+ (b + 5c) 



s-3d 



l-2d 



+ (-26 -8c) 



s-3d 



l-2d 



+ (-b + 4c), l + d<\s\<2 



wherein j = t /At and 0 < d < 0.5. 
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61. The apparatus according to claim 54, wherein said plurality of kernels are given 
by: 

h (s x ,s y )Q =0 = -jj [h(s x ) c=05 • h(s y ) c=0 } 
h ( s x> s y)Q=n/2 = { h (s x )c=0 • Ks y )c=0J 



s x~'y 



S X Sy 



'c=0 v 2 J c =0.5 
wherein s x = x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. s 

62. The apparatus according to claim 54, wherein the labels take precedence over 
said angle of orientation when forming said second mapping of said discrete sample 
values 

63. The apparatus according to claim 54, wherein said fourth mapping is at a 
different resolution to said first mapping. 

64. The apparatus according to claim 54, wherein said image data is colour image 
data. 

65. The apparatus according to claim 54, said apparatus further comprising: 
second calculating means for calculating a text indicator value, C; and 

comparing means for comparing said text indicator value with a threshold value, wherein 
said labelling of each discrete sample value within each text region is based on said 
comparison. 

66. The apparatus according to claim 65, wherein said text indicator, C, is of the 
form: 
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C = max(|Po-^|), ig1,..,8 

and wherein / is the index of the 8 nearest neighbour discrete sample values to a centre 
discrete sample value, PO. 

5 67. The apparatus according to claim 65, wherein said means for identifying 
performs a cleaning operation on said text labels. 

68. The apparatus according to claim 67, wherein said cleaning operation is a 
morphological opening operation. 

10 

69. The apparatus according to claim 54, wherein said first calculating means is 
configured to carry out the following functions: 

calculating edge response values for each of said discrete sample values; 
calculating a gradient magnitude value based on said edge response values; 
15 comparing said gradient magnitude value with a threshold value; 

classifying a current pixel on the basis of said comparison; 
calculating said angle of orientation for a current pixel based on said comparison; 

and 

storing said angle of orientation. 



20 



25 



70. The apparatus according to claim 69, wherein said gradient magnitude value, Gm 
, is of the form: 

G ffl =VG v 2 +G A \and 
wherein Gv and Gh are the vertical and horizontal edge responses, respectively. 

71. The apparatus according to claim 69, wherein said edge gradient value, G6 , is of 
the form: 

G e =tan-^, 



CFP1111AU RC07 483325 



[O:\CISRAVRC\RC07]AUspeci:SaF 



-38- 

wherein Gv and Gh are the vertical and horizontal edge responses, respectively. 

72. The apparatus according to claim 54, wherein said manipulating means is 
configured to carry out the following functions: 

5 (i) accumulating a number of discrete data values of each angle of orientation for 

one of a plurality of portions of said discrete data values; 

(ii) calculating a highest value and lowest value of discrete sample values for 
each angle of orientation; 

(iii) comparing said highest and lowest values with highest and lowest threshold 
10 values, respectively; 

(iv) reassigning an angle of orientation of said discrete data values of said portion 
on the basis of said comparison; and 

(v) repeating the above functions (i) to (iv) for each of said portions of said 
discrete data values. 

15 

73. The apparatus according to claim 72, wherein said plurality of portions of said 
discrete data values is five portions. 

74. The apparatus according to claim 54, wherein a modified cubic interpolation 
20 kernel is applied to a discrete data value which is labelled as text. 

75. The apparatus according to claim 74, wherein said modified cubic interpolation 
kernel, h(s), is of the form: 



h(s) = 



25 



1, -d<s<d 

0, (l-rf)> *>(!-</) 



s-d 
I -2d 



s-d 
\-2d 



+ 1. 
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wherein s= t/At is a normalised coordinate that has integer values at a sample point and 0 
< d < 0.5. 

76. The apparatus according to claim 74, wherein a steerable cubic interpolation 
5 kernel is applied to a discrete data value which is classified as an edge. 



10 



15 



77. The apparatus according to claim 76, wherein said steerable cubic interpolation 
kernels, hfsx.sy), are of the form: 



Ks x >Sy)9=o = -jj [h(s x )c=0.5 ■ h(s y )c=o] 
Ks x ,s y )d=n/2 = ^JJ { h ( s x)c=0 ' h (s y ) c =o.S 
h ( s x>s y )Q =n /4=-jj< 

h ( S X^y)Q=3 n /4 = -jj 



{ 2 Lo.S { J K-0 



wherein s x - x/Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. 

78. The apparatus according to claim 76, wherein a conventional cubic interpolation 
kernel is applied to a discrete data value which is classified as smooth. 



79. The apparatus according to claim 78, wherein said conventional cubic 
20 interpolation kernel is of the form: 



(2-|6-c)H^(-3 + 2fe + c)H 2 + (l-I/,), | 5 |<1 

(-£*-*)M 3 +(* + 5^ 1<H<2 
0, Otherwise 



and wherein 6 = 0 and c — 0.5. 
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80. A computer readable medium for storing a program for an apparatus which 
processes data, said processing comprising a method of interpolating image data 
comprising a first mapping of discrete sample values, said program comprising: 

code for identifying text regions within said first mapping and labelling each 
5 discrete sample value within each text region; 

code for calculating edge information for each of said discrete sample values of 
said image data to identify edge sample values and storing an angle of orientation for each 
of said edge sample values; 

code for combining said labels and said angle of orientation for each of said 
10 discrete sample values to form a second mapping of said discrete sample values; 

code for manipulating said angle of orientation for each edge sample value 
within said second mapping to form a third mapping of said discrete sample values; 

code for manipulating said image data of said third mapping to form a fourth 
mapping of said image data; and 
15 code for interpolating each sample value of said fourth mapping with a first one 

of a plurality of kernels depending on said labels and said angle of orientation of each of 
said sample values of said fourth mapping to form a fifth mapping of said image data. 



20 



81. The computer readable medium according to claim 80, said program further 
comprising: 

code for associating each discrete sample value of said fourth mapping with a 
corresponding discrete sample value of said third mapping; 

code for scaling said third mapping of said image data based on said association. 



25 82. 



The computer readable medium according to claim 80, wherein said program 
further comprises code for interpolating said image data of said third mapping using a 



second kernel. 
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83. The computer readable medium according to claim 82, wherein said second 
kernel is an NN interpolation kernel. 

84. The computer readable medium according to any one of claim 80, wherein said 
labels and said angle of orientation of each of said sample values of said fourth mapping 
are used to select kernel parameter values of said first kernel. 



85. The computer readable medium according to claim 80, wherein said first kernel 
is a universal interpolation kernel, h(s). 

86. The computer readable medium according to claim 85, wherein said universal 
interpolation kernel, h(s), is of the form: 



h(s) = 



1, 0£|s|<</ 



(2--b-c) 

2 J \-2d 

0, l-d<\s\$l + d 



s-d 



+ (-3 + 2b + c) 



s-d 



\-2d 



+ 0--U), d<\s\<\-d 



s-3d 



(--b-c) 

6 'l-2d 

0, Otherwise 



+ (b + 5c) 



s-3d 



\-2d 



+ (-26 -8c) 



s-3d 



\-2d 



+ (-jfc + 4c), l+<f<|s|<2 



wherein s = t/At and 0 £ d < 0.5. 



87. The computer readable medium according to claim 80, wherein said plurality of 
kernels are given by: 

Ks x >Sy)9 = o = [h(s X Jc=0.5 ■ h (s y )c=o) 
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» • » • 



• ♦ 



wherein ^= a/4x and Sy=y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and , indicates matrix multiplication. 



88. The computer readable medium according to claim 80, wherein the labels take 
precedence over said angle of orientation when forming said second mapping of said 
discrete sample values 

10 89. The computer readable medium according to claim 80, wherein said fourth 
mapping is at a different resolution to said first mapping. 

90. The computer readable medium according to claim 80, wherein said image data 
is colour image data. 

15 

91. The computer readable medium according to claim 80, said program further 
comprising: 

code for calculating a text indicator value, C; and 

code for comparing said text indicator value with a threshold value, wherein said 
20 labelling of each discrete sample value within each text region is based on said 
comparison. 

92. The computer readable medium according to claim 91, wherein said text 
indicator, C, is of the form: 

25 C = max(j/>o-/>|), iel,..,8 

and wherein j is the index of the 8 nearest neighbour discrete sample values to a centre 
discrete sample value, P0. 
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93. The computer readable medium according to claim 91, said program further 
comprising: 

code for performing a cleaning operation on said text labels. 

94. The computer readable medium according to claim 93, wherein said cleaning 
operation is a morphological opening operation. 

95. The computer readable medium according to claim 80, said program further 
comprising: 

code for calculating edge response values for each of said discrete sample values; 
code for calculating a gradient magnitude value based on said edge response 
values; and 

code for comparing said gradient magnitude value with a threshold value; 
code for classifying a current pixel on the basis of said comparison; 
code for calculating said angle of orientation for a current pixel based on said 
comparison; and 

code for storing said angle of orientation. 

96. The computer readable medium according to claim 95, wherein said gradient 
magnitude value, Gm, is of the form: 

G m =VG v 2 +G A 2 , and 
wherein Gv and Gh are the vertical and horizontal edge responses, respectively. 

97. The computer readable medium according to claim 95, wherein said edge 
gradient value, G6 , is of the form: 

G,=tan-'^, 

wherein Gv and Gh are the vertical and horizontal edge responses, respectively. 
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98. The computer readable medium according to claim 80, said program further 
comprising: 

code for accumulating a number of discrete data values of each angle of 
5 orientation for one of a plurality of portions of said discrete data values; 

code for calculating a highest value and lowest value of discrete sample values 
for each angle of orientation; 

code for comparing said highest and lowest values with highest and lowest 
threshold values, respectively; and 
0 code for reassigning an angle of orientation of said discrete data values of said 

portion on the basis of said comparison. 



15 



99. The computer readable medium according to claim 80, wherein a modified cubic 
interpolation kernel is applied to a discrete data value which is labelled as text. 

100. The computer readable medium according to claim 98, wherein said modified 
cubic interpolation kernel, h(s), is of the form: 



h(s) = 



1, -d< s<d 
0,(}-d)> s>(l-d) 



s-d 



\-2d 



-3 



s-d 



\-2d 



+ 1, 



wherein s= t/At is a normalised coordinate that has integer values at a sample point and 0 
<d<0.5. 



101. The computer readable medium according to claim 80, wherein a steerable cubic 
interpolation kernel is applied to a discrete data value which is classified as an edge. 
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102. The computer readable medium according to claim 101, wherein said steerable 
cubic interpolation kernels, h(sx,sy), are of the form: 

h (s x ,s y )Q =0 = -L \h(s x ) c=os ■ h(s y ) c=0 } 
h (s x ,Sy)Q =n/2 = -j= {h(s x ) c=0 ■ h(s y ) c=05 



Ks x ,s y )Q =n/4 =-j=< 
h (s x ,Sy)B=3n/4 =^jj< 



+ *y) 

2 K=0.5 



4~2 , 



c=0j 





1 


■h 


s x s y 




7T 


I 42 J 


c=0 


I 2 J 


c=0.5 J 



wherein s x - X /Ax and s y =y/Ay are re-sampling distances in the horizontal and vertical 
directions, respectively, and . indicates matrix multiplication. 

103. The computer readable medium according to claim 101, wherein a conventional 
cubic interpolation kernel is applied to a discrete data value which is classified as smooth. 

104. The computer readable medium according to claim 101, wherein said 
conventional cubic interpolation kernel is of the form: 

3 



Ks) = 



(2--b-c)\s? + (-3 + 2b + c)\s\ 2 +(1 -h), \s\ < 1 
^ 3 

(- » b - c)\sf + (b + 5c)|*| 2 + (-2b - 8c)|*| + (±b + 4c), 1 < |5| < 2 

0, Otherwise 



and wherein b = 0 and c = 0.5. 



,105. A method of interpolating a first set of discrete sample values to generate a 
second set of discrete sample values using one of a plurality of interpolation kernels, 
substantially as hereinbefore described with reference to any one of the embodiments 
illustrated in the accompanying drawings. 



as 
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106. A method of interpolating image data, substantially as hereinbefore described 
with reference to any one of the embodiments as illustrated in the accompanying 
drawings. 

107. An apparatus for interpolating image data, substantially as hereinbefore 
described with reference to any one of the embodiments as illustrated in the 
accompanying drawings. 

108. A computer readable medium for storing a program for an apparatus which 
processes data, said processing comprising a method of interpolating image data, said 
program being substantially as hereinbefore described with reference to any one of the 
embodiments as illustrated in the accompanying drawings. 

Dated 13 December, 1999 
Canon Kabushiki Kaisha 

Patent Attorneys for the Applicant/Nominated Person 

SPRUSON & FERGUSON 
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